Non-transitory storage medium having information processing program stored therein, information processing apparatus, and information processing method

ABSTRACT

Provided is a new information processing apparatus that emits an operation sound during an operation on a plurality of GUI components. The information processing apparatus comprises: an input detection unit for detecting primary input and secondary input to each of a plurality of buttons displayed on a screen; an operation sound output unit for outputting an operation sound in time with the primary input to one of the plurality of buttons; and a process execution unit for, when the secondary input to the button to which the primary input has been given is detected, executing a process that is assigned to the button and is different from the outputting of the operation sound, where the operation sound output unit raises the pitch of the output operation sound higher as the detection interval of the primary input to different buttons of the plurality of buttons becomes shorter.

CROSS REFERENCE TO RELATED APPLICATION

This nonprovisional application is based on Japanese Patent ApplicationNo. 2021-179135 filed with the Japan Patent Office on Nov. 2, 2021, theentire contents of which are hereby incorporated by reference.

FIELD

The present disclosure relates to a graphical user interface (GUI)technique.

BACKGROUND AND SUMMARY

User interfaces having icons, buttons, subwindows, and the likedisplayed on a screen have conventionally been used for computers, videogames, and the like. Techniques to output an operation sound in responseto an operation in such user interfaces are also known.

Japanese Patent Laid-Open Application No. 2001-51759 discloses anapparatus for producing an operation sound that enhances a sense ofreality and naturalness in object operations. Japanese Patent Laid-OpenApplication No. 2001-51759 describes outputting a dragging sound such as“zuzuzuzu” in response to a drag of an icon with a mouse or a touchpanel. The document also describes changing the timbre and pitch of thedragging sound in accordance with the speed of the drag.

In the conventional techniques to emit operation sounds, each operationsound would be related to each operation object in such a way that thistimbre is used when this button is touched and this sound is emittedwhen this icon is dragged.

A purpose of the present technique made in view of the above-mentionedbackground is to provide a new non-transitory storage medium having aninformation processing program stored therein, information processingapparatus, and information processing method for outputting an operationsound.

A non-transitory storage medium according to one aspect has aninformation processing program stored therein, and the informationprocessing program is executed in a computer of an informationprocessing apparatus and causes the computer to function as: inputdetection means for detecting primary input and secondary input to eachof a plurality of GUI components; operation sound output means foroutputting an operation sound in time with the primary input to one ofthe plurality of GUI components; and process execution means for, whenthe secondary input to the GUI component to which the primary input hasbeen given is detected, executing a GUI-component-assigned process thatis assigned to the GUI component and is different from the outputting ofthe operation sound, where the operation sound output means outputs theoperation sound at a higher pitch as a detection interval of the primaryinput to different GUI components of the plurality of GUI componentsbecomes shorter.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows an example of a state in which a left controller and aright controller are attached to a game apparatus of an embodiment.

FIG. 2 shows an example of a state in which the left controller and theright controller are each individually from the game apparatus of theembodiment.

FIG. 3 is a six-view drawing showing an example of the game apparatus ofthe embodiment.

FIG. 4 is a six-view drawing showing an example of the left controllerof the embodiment.

FIG. 5 is a six-view drawing showing an example of the right controllerof the embodiment.

FIG. 6 is a block diagram showing a configuration of a game systemimplemented by executing an information processing program of theembodiment.

FIG. 7A shows an example of a selection screen displayed on the gameapparatus.

FIG. 7B shows an example of the screen where a button “Item A” isfocused on.

FIG. 8A shows an example in which the screen has transitioned to ScreenA.

FIG. 8B shows an example in which Screen A pops up and is superimposed.

FIG. 9A is a selection screen for selecting a hairstyle for a character.

FIG. 9B shows an example of the screen where “Hairstyle B” is selected.

FIG. 10 is a flowchart showing an operation of the game system of theembodiment.

FIG. 11 is a flowchart showing an operation of a counter process.

FIG. 12 is a flowchart showing a process of determining pitch by meansof an operation sound output unit.

DETAILED DESCRIPTION OF NON-LIMITING EXAMPLE EMBODIMENTS

Now, a non-transitory storage medium having an information processingprogram stored therein, an information processing apparatus, and aninformation processing method of the embodiment will be described withreference to the drawings. The following description is merelyillustrative of preferred modes and is not intended to limit theinvention described in the claims.

A non-transitory storage medium according to one aspect has aninformation processing program stored therein, and the informationprocessing program is executed in a computer of an informationprocessing apparatus and causes the computer to function as: inputdetection means for detecting primary input and secondary input to eachof a plurality of GUI components; operation sound output means foroutputting an operation sound in time with the primary input to one ofthe plurality of GUI components; and process execution means for, whenthe secondary input to the GUI component to which the primary input hasbeen given is detected, executing a GUI-component-assigned process thatis assigned to the GUI component and is different from the outputting ofthe operation sound, where the operation sound output means outputs theoperation sound at a higher pitch as a detection interval of the primaryinput to different GUI components of the plurality of GUI componentsbecomes shorter.

“GUI components” are components used in an interface that allows visualunderstanding of commands, instructions, or the like for a computer andspecifying of actions. Examples of GUI components include a button, anapplication icon, or the like displayed on a screen. A“GUI-component-assigned process” is a process to be performed byconfirming the selection of a GUI component. For example, when a GUIcomponent is an application icon, the execution of the applicationindicated by the icon is the GUI-component-assigned process. When a GUIcomponent is a button, a transition to the next screen indicated by thebutton is the GUI-component-assigned process.

Since the operation sound is output at a higher pitch when the primaryinput is successively given to each of the plurality of GUI components,an operation sound different from that for a single GUI component can beproduced, and the operational feeling can be improved. As for theconfiguration in which the operation sound is output at a higher pitchas a detection interval of the primary input becomes shorter, aconfiguration in which the pitch is raised when the detection intervalis shorter than a predetermined threshold may be used. Thisconfiguration allows the pitch of the operation sound to be raisedcumulatively when the detection interval remains shorter than thepredetermined threshold. A configuration in which the pitch isdetermined in accordance with the detection interval when it is shortmay also be used. This configuration allows the pitch of the operationsound to be raised as the detection interval becomes shorter. The pitchmay be raised either stepwise or continuously.

The primary input and the secondary input may both be given by a touchinput, and the input detection means may detect the primary input whencoordinates of the touch input become included in one of the pluralityof GUI components' own areas, and may detect the secondary input whencoordinates of the touch input at an end thereof are included in one ofthe plurality of GUI components' own areas. This configuration allowsdetecting the primary input successively and outputting the operationsound at a higher pitch by moving the touch input between the pluralityof GUI components' own areas. Moreover, by ending the touch input withinone of the GUI components' own area, the GUI-component-assigned processfor the GUI component can be executed.

The primary input and the secondary input may both be given by actuatinga hardware component, and the computer may be further caused to functionas focus change means for, when the primary input is detected, changingthe GUI component to be focused on among the plurality of GUI componentsas well as displaying the focused GUI component visually differentlyfrom an unfocused GUI component. This configuration allows detecting theprimary input successively and outputting the operation sound at ahigher pitch by actuating a hardware component.

The input detection means may detect a Type 1 input given by using afirst input apparatus and a Type 2 input given by using a second inputapparatus, and the operation sound output means may output the operationsound that is different in at least one of pitch and timbre between whenthe primary input of Type 1 based on the Type 1 input is detected andwhen the primary input of Type 2 based on the Type 2 input is detected.This configuration allows different operation sounds produced bydifferent input apparatuses to be enjoyed.

The Type 1 input may be a touch input and the Type 2 input may be givenby actuating a hardware component. Then, the operation sound outputmeans may output the operation sound at a lower pitch when the primaryinput of Type 2 is detected compared to when the primary input of Type 1is detected at the detection interval equal to that of the primary inputof Type 2.

When input is given by actuating a hardware component, the primary inputto a GUI component may be done more unconsciously compared to when theinput is a touch input. For example, when the interface uses a hardwarebutton that moves a cursor from right to left or up and down, anunintended GUI component is sometimes selected before an intended one isselected. When the input is given by actuating a hardware component, afeeling of strangeness about a change in pitch can be reduced by settingthe pitch lower than when the input is a touch input.

The input detection means may successively detect the primary input toeach of the plurality of GUI components when one operation is continuedin the input given by actuating a hardware component. The phrase “whenone operation is continued” means, for example, when a hardware buttonis held down and when an analog stick is kept tilted. This configurationallows the detection interval of the primary input to be shortenedeasily even when the input is given by actuating a hardware component.

The process execution means may change the screen to a state in which noinput is allowed to be given to the GUI component, as theGUI-component-assigned process.

When the secondary input to one of the plurality of GUI components isdetected, the process execution means may cause the screen on which theGUI component is placed to transition to another screen so as to changethe screen to a state in which no input is allowed to be given to theGUI component.

When the secondary input to one of the plurality of GUI components isdetected, the process execution means may overlay another screen on alayer in which the GUI component is placed so as to change the screen toa state in which no input is allowed to be given to the GUI component.

An information processing apparatus according to one aspect comprises:input detection means for detecting primary input and secondary input toeach of a plurality of GUI components; operation sound output means foroutputting an operation sound in time with the primary input to one ofthe plurality of GUI components; and process execution means for, whenthe secondary input to the GUI component to which the primary input hasbeen given is detected, executing a GUI-component-assigned process thatis assigned to the GUI component and is different from the outputting ofthe operation sound, where the operation sound output means outputs theoperation sound at a higher pitch as a detection interval of the primaryinput to different GUI components of the plurality of GUI componentsbecomes shorter. The information processing apparatus of the embodimentcan comprise the various constituent components of the above-describedinformation processing program.

An information processing method according to one aspect is foroutputting an operation sound in time with an input to a GUI component,and the information processing method comprises the steps of: detectingprimary input and secondary input to each of a plurality of GUIcomponents; outputting an operation sound in time with the primary inputto one of the plurality of GUI components; and when the secondary inputto the GUI component to which the primary input has been given isdetected, executing a GUI-component-assigned process that is assigned tothe GUI component and is different from the outputting of the operationsound, where, in the step of outputting the operation sound, theoperation sound is output at a higher pitch as a detection interval ofthe primary input to different GUI components of the plurality of GUIcomponents becomes shorter. The information processing method of theembodiment can comprise the various constituent components of theabove-described information processing program.

Hereinafter, an information processing program, an informationprocessing apparatus, and an information processing method of thepresent embodiment will be described with reference to the drawings.While a game system is cited and described here as an example of theinformation processing apparatus, the information processing apparatusof the embodiment is not limited to a game system, but can also beapplied to a smartphone, a tablet terminal, a navigation apparatus, orthe like.

An example of a game system 1 in the present embodiment includes a gameapparatus 2, a left controller 3, and a right controller 4. The leftcontroller 3 and the right controller 4 can be individually attached toand detached from the game apparatus 2. In other words, the game system1 can be used as an integrated apparatus by attaching the leftcontroller 3 and the right controller 4 individually to the gameapparatus 2. Alternatively, the game system 1 can be used in a statewhere the game apparatus 2, the left controller 3, and the rightcontroller 4 are separated from one another (refer to FIG. 2 ). In thefollowing, a hardware configuration of the game system 1 of the presentembodiment will be described first, and then the control of the gamesystem 1 of the present embodiment will be described.

FIG. 1 shows an example of a state in which the left controller 3 andthe right controller 4 are attached to the game apparatus 2. Asillustrated in FIG. 1 , the left controller 3 and the right controller 4are individually attached to and integrated with the game apparatus 2.The game apparatus 2 is an information processing apparatus forexecuting various types of processing (e.g., game processing) in thegame system 1. The game apparatus 2 has a display 12. Each of the leftcontroller 3 and the right controller 4 is an apparatus having anoperation unit for a user to perform input.

FIG. 2 shows an example of a state in which the left controller 3 andthe right controller 4 are individually removed from the game apparatus2. As illustrated in FIGS. 1 and 2 , the left controller 3 and the rightcontroller 4 can be attached to and detached from the game apparatus 2.In the following description, the left controller 3 and the rightcontroller 4 will be collectively referred to as the “controller” insome cases.

FIG. 3 is a six-view drawing illustrating an example of the gameapparatus 2. As illustrated in FIG. 3 , the game apparatus 2 has aplate-like housing 11. In the present embodiment, a main surface of thehousing 11 (in other words, the front side, that is, the surface onwhich the display 12 is provided) is substantially rectangular in shape.

The shape and size of the housing 11 are arbitrary. For example, thehousing 11 may be of a portable size. Moreover, the game apparatus 2alone or the integrated apparatus in which the left controller 3 and theright controller 4 are attached to the game apparatus 2 may be aportable apparatus. The game apparatus 2 or the integrated apparatus maybe a handheld apparatus. The game apparatus 2 or the integratedapparatus may also be a transportable apparatus.

As illustrated in FIG. 3 , the game apparatus 2 has the display 12provided on the main surface of the housing 11. The display 12 displaysan image generated by the game apparatus 2. In the present embodiment,the display 12 is a liquid crystal display (LCD). Note that the display12 may be any type of display apparatus.

The game apparatus 2 has a touch panel 13 on a screen of the display 12.In the present embodiment, the touch panel 13 is of a type capable ofmulti-touch input (e.g., a capacitive type). Note that the touch panel13 may be of any kind such as a type capable of single touch input(e.g., a resistive type).

The game apparatus 2 has a speaker (i.e., a speaker 80 illustrated inFIG. 6 ) inside the housing 11. As illustrated in FIG. 3 , speaker holes11 a and 11 b are formed on the main surface of the housing 11. Theoutput sound of the speaker 80 is output from each of the speaker holes11 a and 11 b.

The game apparatus 2 has a left side terminal 17 for performing wiredcommunication with the left controller 3, and a right side terminal 21for performing wired communication with the right controller 4.

As illustrated in FIG. 3 , the game apparatus 2 has a slot 23. The slot23 is provided on the upper surface of the housing 11. The slot 23 has ashape that enables a predetermined type of storage medium to beattached. The predetermined type of storage medium is, for example, astorage medium (e.g., a dedicated memory card) dedicated to the gamesystem 1 and information processing apparatuses of the same type as thegame system 1. The predetermined type of storage medium is used forstoring, for example, data used in the game apparatus 2 (e.g., saveddata of an application) and/or a game program of the present embodimentexecuted in a computer of the game apparatus 2. The game apparatus 2also has a power button 28.

The game apparatus 2 has a lower terminal 27. The lower terminal 27 isused by the game apparatus 2 to communicate with a cradle. In thepresent embodiment, the lower terminal 27 is a USB connector (morespecifically, a female connector). When the above-described integratedapparatus or the game apparatus 2 alone is mounted on the cradle, thegame system 1 can display an image generated and output by the gameapparatus 2 on a stationary monitor. Moreover, in the presentembodiment, the cradle has a function to charge the above-describedintegrated apparatus or the game apparatus 2 alone mounted on thecradle. The cradle also has a function of a hub apparatus (specifically,a USB hub).

FIG. 4 is a six-view drawing illustrating an example of the leftcontroller 3. As illustrated in FIG. 4 , the left controller 3 has ahousing 31. In the present embodiment, the housing 31 has a verticallylong shape, that is, a long shape in the vertical direction (i.e., inthe y-axis direction illustrated in FIGS. 1 and 4 ). The left controller3 can also be held in a vertically long orientation in a state where itis detached from the game apparatus 2. The housing 31 has a shape andsize that can be held with one hand, in particular with the left hand,when held in a vertically long orientation. Moreover, the leftcontroller 3 can also be held in a landscape orientation. When held in alandscape orientation, the left controller 3 may be held with bothhands.

The left controller 3 has an analog stick 32. As illustrated in FIG. 4 ,the analog stick 32 is provided on the main surface of the housing 31.The analog stick 32 can be used as a direction input unit capable ofinputting a direction. By tilting the analog stick 32, a user can inputa direction corresponding to the tilt direction (and a sizecorresponding to the tilt angle). Instead of the analog stick, the leftcontroller 3 may be provided with a cross key, a slide stick capable ofslide input, or the like as the direction input unit. Moreover, inputcan be given by pressing the analog stick 32 in the present embodiment.

The left controller 3 has various operation buttons. The left controller3 has four operation buttons 33 to 36 (specifically, a right button 33,a down button 34, an up button 35, and a left button 36) on the mainsurface of the housing 31. Moreover, the left controller 3 has arecording button 37 and a − (minus sign) button 47. The left controller3 has a first L button 38 and a ZL button 39 on the upper left of theside of the housing 31. The left controller 3 also has a second L button43 and a second R button 44 on the housing 31's side which is to engagewith the game apparatus 2 when the left controller 3 is attached to thegame apparatus 2. These operation buttons are used to give instructionsaccording to various programs (e.g., an OS program and a game program)executed by the game apparatus 2. Furthermore, the left controller 3 hasa terminal 42 for performing wired communication with the game apparatus2.

FIG. 5 is a six-view drawing illustrating an example of the rightcontroller 4. As illustrated in FIG. 5 , the right controller 4 has ahousing 51. In the present embodiment, the housing 51 has a verticallylong shape, that is, a long shape in the vertical direction. The rightcontroller 4 can also be held in a vertically long orientation in astate where it is detached from the game apparatus 2. The housing 51 hasa shape and size that can be held with one hand, in particular with theright hand, when held in a vertically long orientation. Moreover, theright controller 4 can also be held in a landscape orientation. Whenheld in a landscape orientation, the right controller 4 may be held withboth hands.

Similarly to the left controller 3, the right controller 4 has an analogstick 52 as a direction input unit. In the present embodiment, theanalog stick 52 has the same configuration as the analog stick 32 of theleft controller 3. Instead of the analog stick 52, the right controller4 may be provided with a cross key, a slide stick capable of slideinput, or the like. Similarly to the left controller 3, the rightcontroller 4 has four operation buttons 53 to 56 (specifically, an Abutton 53, a B button 54, an X button 55, and a Y button 56) on the mainsurface of the housing 51. Moreover, the right controller 4 has a +(plus sign) button 57 and a home button 58. The right controller 4 alsohas a first R button 60 and a ZR button 61 on the upper right of theside of the housing 51. Similarly to the left controller 3, the rightcontroller 4 has a second L button 65 and a second R button 66.Furthermore, the right controller 4 has a terminal 64 for performingwired communication with the game apparatus 2.

(Configurations to Output the Operation Sound)

FIG. 6 is a block diagram showing a configuration of the game system 1implemented by executing the information processing program of theembodiment. FIG. 6 just shows a configuration required to describe theinformation processing program of the embodiment, and the game system 1may have a configuration other than the one shown in FIG. 6 .

The left controller 3 comprises a communication controller 111 forcommunicating with the game apparatus 2, a memory 112, buttons 113(specifically, the above-mentioned buttons 33 to 39, 43, 44, and 47),and the analog stick (denoted by “Stick” in FIG. 6 ) 32. The buttons 113and the analog stick 32 output information on operations performed onthemselves to the communication controller 111 in a timely manner andrepeatedly. The communication controller 111 sends the information onoperations to the game apparatus 2.

The right controller 4 comprises a communication controller 114 forcommunicating with the game apparatus 2, a memory 115, buttons 116(specifically, the above-mentioned buttons 53 to 58, 60, 61, 65, and66), and the analog stick 52. The buttons 116 and the analog stick 52output information on operations performed on themselves to thecommunication controller 114 in a timely manner and repeatedly. Thecommunication controller 114 sends the information on operations to thegame apparatus 2.

The information processing program is stored in an internal storagemedium, such as a flash memory 81 and a DRAM 82, of the game apparatus2, an external storage medium that is attached to the slot 23, or thelike. The execution of the information processing program causes acontroller 100 to function as an input detection unit 101, an operationsound output unit 102, a process execution unit 103, and a focus changeunit 104.

FIG. 7A shows an example of a screen displaying buttons that are aplurality of GUI components. FIG. 7B shows an example of the screenwhere a button “Item A” is focused on. As shown in FIG. 7A, eightbuttons from “Item A” to “Item H” are aligned in two columns on thescreen.

The input detection unit 101 has a function to detect primary input andsecondary input to each of the plurality of buttons displayed on thescreen. In the embodiment, the primary input is to select one of theplurality of buttons, and the secondary input is to confirm theselection of a button. In an example described here, the input detectionunit 101 detects input given through the touch panel 13, as well asthrough the right button 33, the down button 34, the up button 35, andthe left button 36 (hereinafter collectively referred to as the“directional buttons”) and the A button 53. In other words, input isgiven through two types of input apparatuses, the touch panel 13 and thehardware buttons (the directional buttons and the A button 53).

While the directional buttons and the A button 53 are cited above asexamples of hardware input apparatuses, hardware input apparatuses arenot limited to them. For example, the analog stick 32 or 52 may be usedas a hardware input apparatus instead of the directional buttons. Whenthe analog stick 32 or 52 is used, the primary input may be detected bythe tilt of the analog stick 32 or 52 and the secondary input may bedetected by the A button 53. Alternatively, when the analog stick 32 or52 is used, the secondary input may be detected by the pressing of theanalog stick 32 or 52 instead of the A button 53.

When input is given through the touch panel 13, the input detection unit101 detects the primary input when the coordinates of a touch inputbecome included in one of the plurality of buttons' own areas. The inputdetection unit 101 detects the secondary input when a touch input endswhile the coordinates of the touch input are in a button's display area.Note that the end of a touch input is the end of a touch on the touchpanel 13 (e.g., the release of a finger or stylus from the touch panel13), and the shift of the coordinates of a touch input out of a button'sdisplay area during the touch input is not deemed to be the end of thetouch input,

FIG. 73 shows an example of the screen where the primary input to thebutton “Item A” is detected. The focus change unit 104 has performed afocus change step on the button “Item A,” and is displaying it visuallydifferently from unfocused buttons. Specifically, the display area ofthe button “Item A” is made slightly larger than the other buttondisplay areas, and the color of the display area of the button “Item A”is made different from that of the other button display areas. While amode in which the size and the color are changed is cited here, thefocus change unit 104 may make a focused button visually different fromunfocused buttons in another mode. For example, the focus change unit104 may change only the size or the color, or may point a cursor at afocused button.

When input is given through the hardware buttons, the input detectionunit 101 detects the primary input by the directional buttons, anddetects the secondary input by the A button 53. First, the primary inputwill be described. A default button for the first push of a directionalbutton is predetermined among the plurality of buttons. When one of thedirectional buttons is pushed on the selection screen, the inputdetection unit 101 first detects the primary input to the defaultbutton, and then detects the primary input to a button that is in thedirection indicated by a directional button.

A description will be made with reference to FIGS. 7A and 7B. When adirectional button is pushed on the selection screen shown in FIG. 7A,the primary input to the button “Item A” is detected. This causes astate in which the button “Item A” is focused on as shown in FIG. 7B.

Pushing a directional button in the state shown in FIG. 7B causes theinput detection unit 101 to detect the primary input to a button that isin the directional button's direction. For example, pushing the downbutton 34 causes the detection of the primary input to the button “ItemB” that is below the button “Rem A.” Pushing the right button in thestate shown in FIG. 7B causes the detection of the primary input to thebutton “Item E” that is to the right of the button “Rem A.”

The order of the plurality of buttons is preset (in alphabetical orderin the example shown in FIGS. 7A-7B), and pushing the down button 34causes the primary input to be detected according to the order. Forexample, pushing the down button 34 in a state where the primary inputto the button “Item D” has been detected causes the detection of theprimary input to the button “Item E,” and pushing the down button 34 ina state where the primary input to the button “Item H” has been detectedcauses the detection of the primary input to the button “Item A.”Therefore, holding down the down button 34 causes the successivedetection of the primary input to each of the plurality of buttonsdisplayed on the selection screen. Note that pushing the up button 35causes the primary input to be detected in reverse order of the above.This configuration allows the primary input to be given successively atshort detection intervals by holding down the down button 34 or the upbutton 35.

Next, the secondary input given through the hardware buttons will bedescribed. The input detection unit 101 detects the secondary input bythe A button 53. If the A button 53 is pushed in a state where theprimary input given by a directional button has been detected and one ofthe plurality of buttons has been selected, the input detection unit 101detects the secondary input to the button.

The operation sound output unit 102 has a function to output anoperation sound in time with the primary input to each of the pluralityof buttons. The operation sound has a role to indicate that the primaryinput has been given to a button. Therefore, the timing of outputtingthe operation sound just has to be matched with the timing of theprimary input. The operation sound is a brief sound that can be heardfor a moment. The timbre of it may be the same for all the plurality ofbuttons, or may be different from button to button. For example,different instrument sounds may be used for different buttons.

The operation sound output unit 102 raises the pitch of the outputoperation sound higher when the primary input to different buttons issuccessively detected and as the detection interval of the primary inputbecomes shorter. The process performed by the operation sound outputunit 102 will be described in detail later.

When the input detection unit 101 detects the secondary input, theprocess execution unit 103 performs a process of causing a transition toa screen assigned to the relevant button. The process of causing atransition to a screen assigned to a button is a GUI-component-assignedprocess that is performed by confirming the selection of a button whichis a GUI component.

FIG. 8A shows an example in which the selection of the button “Item A”has been confirmed and the screen has transitioned to Screen A that isassigned to “Item A,” and FIG. 8B shows an example in which Screen Apops up and is superimposed. The process execution unit 103 may clearthe selection screen and display Screen A as shown in FIG. 8A, or maycause Screen A to pop up and be superimposed on the selection screen asshown in FIG. 8B. The game system 1 then allows input to Screen A, butdisallows input to the plurality of buttons on the selection screen.Whether the process execution unit 103 causes a complete transition tothe next screen as shown in FIG. 8A or overlays another window on theselection screen can be determined in accordance with the contents ofthe selection screen and next screen.

While cited above is an example in which input to the selection screenis not accepted after the execution of the process assigned to “Item A”has caused a transition to Screen A, input to buttons displayed on theselection screen may be allowed even after a process assigned to abutton has been executed. An example of this is a case in which aprocess assigned to a button is to show a preview of the selectedcomponent. An example will be described in the following.

FIG. 9A is a selection screen for selecting a hairstyle for a character.Buttons indicating “Hairstyle A” through “Hairstyle H” are aligned intwo rows in FIGS. 9A and 9B. In this example, the buttons are alignedhorizontally in alphabetical order. The order of the buttons are presetin the alphabetical order. Therefore, the right button 33 or the leftbutton 36 is the button to hold down in order to successively give theprimary input when input is given through the directional buttons.

In the screen shown in FIG. 9A, the primary input to the button“Hairstyle B” is detected and the button “Hairstyle B” is focused on. Acharacter with the current hairstyle, Hairstyle A, is displayed in apreview window P. As just described, when the primary input is detected,the display mode of the relevant button changes but the display in thepreview window P is not changed from the current hairstyle.

FIG. 9B shows a screen where the secondary input to the button“Hairstyle B” has been detected. As illustrated, a check mark isdisplayed for the button “Hairstyle B,” and the character with HairstyleB is displayed in the preview window P. The process of displaying thecharacter with selected Hairstyle B in the preview window P is theprocess assigned to the button “Hairstyle B.” In this way, an operationcan be performed on “Hairstyle A” through “Hairstyle H” even on thescreen where the process assigned to the button “Hairstyle B” has beenexecuted. In order to confirm this Hairstyle B displayed in the previewwindow P, a button “SET” should be pushed.

FIG. 10 is a flowchart showing an operation of the game system 1 of theembodiment. While displaying the selection screen having the pluralityof buttons (see FIG. 7A), the game system 1 waits for the primary inputand the secondary input to be detected. Specifically, the game system 1determines whether the primary input is detected or not (S10) and, ifthe primary input is not detected (NO at S10), determines whether thesecondary input is detected or not (S14). If the secondary input is notdetermined to be detected as a result (NO at S14), the operation returnsto the step of detecting the primary input (S10). Repeating this, thegame system 1 waits for the detection of the primary input and thesecondary input.

If the input detection unit 101 detects the primary input (YES at S10),the game system 1 executes a counter process (S20), changes the focus(S11), and determines the pitch in accordance with the counter (S12).The counter just mentioned is a variable whose value is determined inaccordance with the detection interval of the primary input. The countercounts from 0 to 120. The operation sound output unit 102 sets the pitchof the operation sound higher as the counter value increases. The gamesystem 1 concurrently executes the counter process of determining thecounter value and the process of outputting the operation sound or thelike on different tracks.

FIG. 11 is a flowchart showing an operation of the counter processexecuted by the operation sound output unit 102. The counter process istriggered by the detection of the primary input. Note that if theprimary input is detected while the counter process shown in FIG. 11 isbeing executed, the counter process is executed from the start.

If the primary input is detected, the operation sound output unit 102determines whether or not the counter is equal to or less than 100(S21). If the counter is equal to or less than 100 (YES at S21), theoperation sound output unit 102 performs a step of adding 20 to thecounter (S22). If the counter is not equal to or less than 100 (NO atS21), the operation sound output unit 102 skips the counter additionstep since the counter would exceed its upper limit if 20 was added tothe counter. The operation sound output unit 102 then waits 15 ticks(S23), and performs counter subtraction steps (S24 to S26). Note thatone tick varies depending on the tempo at which an effect sound isplayed, and is 1/96 seconds when the tempo is 120.

In the counter subtraction steps, the operation sound output unit 102waits one tick (S24), and determines whether the counter is greater thanzero or not (S25). If the counter is determined to be greater than zeroas a result of the determination (YES at S25), the operation soundoutput unit 102 performs a step of subtracting five from the counter(S26). If the counter is less than five, the counter is set to zerosince the counter would fall below its lower limit if five wassubtracted from the counter.

If the counter is not greater than zero (NO at S25), subtraction fromthe counter is no longer possible, and then the operation sound outputunit 102 skips the step of subtracting from the counter (S26). In otherwords, the counter subtraction steps are not performed if the counter isnot greater than zero. The step of subtracting five from the counter foreach one tick in this way is repeated 24 times in the countersubtraction steps. Consequently, even if the counter is at its maximumbefore the start of the subtraction steps, the counter value becomeszero 24 ticks after the start of the subtraction steps.

As mentioned at the start, however, when the input detection unit 101detects the primary input, the operation sound output unit 102 returnsto the first step (S21) and executes the counter process even if it isin the middle of the flow shown in FIG. 11 . This means that the counterprocess goes back to the start before the counter becomes zero if thedetection interval of the primary input is short, and therefore thecounter value becomes increasingly high when the primary input isdetected at short detection intervals. For example, if the detectioninterval is shorter than or equal to 15 ticks, 20 is added to thecounter (322), the next primary input is detected during the 15-tickwait, the process returns to the start, and therefore the next 20 isadded to the counter (S21 to S22) without the subtraction steps.

The shorter the detection interval becomes, the larger the degree ofincrease of the counter becomes. For example, the counter increases by20 if the detection interval is 15 ticks, and increases by 10 if thedetection interval is 17 ticks. The counter thus increases more as thedetection interval of the primary input becomes shorter, since thedegree of subtraction decreases. In other words, the operation soundoutput unit 102 outputs the operation sound at a higher pitch as thedetection interval of the primary input becomes shorter.

Conversely, if the detection interval of the primary input becomeslonger when the pitch is high, subtraction is performed on the counterthrough the counter subtraction steps (S24 to S26). For example, if theprimary input is detected after the counter subtraction steps have beenrepeated five times or more and 25 or more has been subtracted, thecounter value becomes smaller than the last time the operation sound wasoutput even though 20 is added to the counter (S22), and therefore thepitch becomes lower than the previous operation sound. In this way, thepitch of the output operation sound becomes gradually lower if thedetection interval of the primary input becomes longer.

Returning to FIG. 10 , the process of outputting the operation soundwill be described. While concurrently executing the counter process on adifferent track, the game system 1 performs the step of changing thefocus to focus on a button on which the primary input has been newlydetected (S11). The game system 1 then determines the pitch of theoperation sound in accordance with the counter (S12). The operationsound output unit 102 outputs the operation sound at the determinedpitch (S13). Note that the change of focus (S11) and the outputting ofthe operation sound (S12 and S13) may be performed in reverse order.

The operation sound output unit 102 lowers the increase rate of thepitch of the operation sound when the primary input is given through thehardware buttons (the directional buttons, and the analog sticks 32 and52) compared to when it is given through the touch panel 13. The rate ofchanging the pitch may be adjusted, for example, by performing theaddition of 10 instead of the addition of 20 in the count-up step (S22)in the counter process. The method of adjusting the rate of changing thepitch is not limited to this. For example, the waiting times (S23 andS24) may be lengthened. The operation sound output unit 102 may outputthe operation sound whose timbre is different between when the primaryinput is given by touch input and when the primary input is given bybutton input through the hardware buttons.

The game system 1 determines whether the secondary input is detected ornot (S14). If the secondary input is detected (YES at S14), the gamesystem 1 transitions to a screen indicated by the button to which thesecondary input was given, and displays the transition destinationscreen (S15). If the secondary input is not detected (NO at S14) and theprimary input is detected (YES at Si 0), the game system 1 executes thecounter process (S20) to update the counter value as well as determinesthe pitch in accordance with the counter (S12), and outputs theoperation sound (S13). In this way, the game system 1 repeatedlyperforms the focus change step and the process of outputting theoperation sound (S11 to S13, and S20) based on the detection of theprimary input until the secondary input is detected (YES at S14).

The information processing program of the embodiment can improve theoperational feeling since the pitch of the operation sound becomeshigher when the primary input is successively given to each of theplurality of buttons. A screen having a plurality of buttons exists forthe push of buttons, and therefore it is conventionally thought that anoperation sound is output in order to confirm that a button has beenpushed. In contrast, the information processing program of theembodiment allows the operation sound to be output at different pitchesby sliding a touching finger to rapidly switch between pushed buttons orby moving a cursor. “A play element” is provided to the interface forselecting buttons, and its operation becomes fun. The primary input inthe embodiment corresponds to selection before confirmation of theexecution of a button. This means that a user hears an operation soundwith a varying pitch instead of a monotonous operation sound while theuser is wondering which screen to transition to, and therefore the usercan operate pleasantly.

While a non-transitory storage medium having an information processingprogram stored therein, an information processing apparatus, and aninformation processing method of the invention have been described indetail above with an embodiment, the invention's non-transitory storagemedium having an information processing program stored therein is notlimited to the above-described embodiment.

The above embodiment has been illustrated with the game system 1 whichhas two types of input apparatuses that use touch input and button inputusing hardware buttons, but only touch input or only button input usinghardware buttons may be used for an input apparatus. Not just touchinput and hardware button input but also, for example, motion inputusing an accelerometer and a gyroscope sensor or camera input may beused for an input apparatus. If camera input is used, the primary inputand the secondary input can be given through gestures or the like bydetecting the body motion of a user. Moreover, the primary input and thesecondary input may be accepted through a voice command from a user byusing microphone input.

While the above embodiment has been described with the example in whichthe counter is used for the process of raising the pitch of the outputoperation sound higher as the detection interval of the primary inputbecomes shorter, there may be various algorithms other than the aboveembodiment as to how to determine the pitch based on the detectioninterval, and such algorithms are also included in the scope of theinvention.

FIG. 12 is a flowchart showing a process of determining the pitch bymeans of the operation sound output unit. The operation sound outputunit determines whether the primary input is detected or not (S30) and,if the primary input is not detected (NO at S30), waits for thedetection of the primary input. If the primary input is detected (YES atS30), the detection interval of the primary input is stored (S31). Dataof the last N detection intervals is cyclically stored here, and theprevious data is erased.

The operation sound output unit then calculates the average of the lastN detection intervals (S32) and, on the basis of the calculated averagedetection interval, determines the pitch of the operation sound so thatit becomes higher as the average detection interval becomes smaller(S33). The operation sound output unit outputs the operation sound atthe determined pitch (S34).

This configuration allows the pitch of the operation sound to be raisedas the detection interval becomes shorter. While the average of the lastN detection intervals is taken in the example shown in FIG. 12 , arepresentative value of the last N detection intervals may bedetermined. For example, the representative value may be the mode of thedata of the last N detection intervals. Alternatively, a weightedaverage may be calculated after the data is weighted so that more recentdata is weighted more heavily. Specifically, let d₁, . . . , d_(N) drybe detection intervals of the primary input lined up in reverse orderstarting from the last one, let α₁, . . . , α_(N) be weights (α₁>α₂ . .. >α_(N)), and a representative value of the detection intervals, d, isdetermined by the following formula.

d=(α₁ ×d ₁+α₂ ×d ₂+ . . . +α_(N) ×d _(N))/N

If N=1 is set, the pitch can be determined based on the detectioninterval between the last primary input and the previous one. Thissetting allows the pitch of the operation sound to sensitively respondto the detection interval of the primary input.

Alternatively, the detection interval of the primary input may beclassified into several classes, and the pitch may be determined foreach class. For example, the detection interval of the primary input of:less than 15 ticks may be classified as Class 1; 15 ticks or more andless than 20 ticks may be classified as Class 2; 20 ticks or more andless than 25 ticks may be classified as Class 3; 25 ticks or more andless than 30 ticks may be classified as Class 4; and 30 ticks or moremay be classified as Class 5, and the pitch may be determined inaccordance with the class. Specifically, the smaller the number of theclass is, the higher the pitch is determined to be.

While the above embodiment has been described with the example in whichthe operation sound is output at a higher pitch as the detectioninterval of the primary input becomes shorter, another parameter thanthe pitch may be changed. To be specific, the volume or timbre of theoperation sound may be changed as the detection interval of the primaryinput becomes shorter.

Alternatively, instead of raising the pitch higher i.e., increasing thefrequency) as the detection interval of the primary input becomesshorter, effect sounds of different pitches may be prepared in advanceand may be output in sequence so that the pitch becomes higher. Theeffective sounds of different pitches may have different timbres inaddition to the pitches. Moreover, the effect sounds to be prepared mayconstitute musical composition data comprising their respective pitches.This allows the musical composition data to be output to play a melodyin accordance with the successively detected primary input.

While the selection screen displaying buttons has been described withFIGS. 7A-7B in the above embodiment, the game system may have aplurality of selection screens. The timbre of the operation sound to beoutput at the time of the detection of the primary input may be madedifferent for each selection screen in this case. In addition to this,the rate of raising the pitch may be made different in accordance withthe timbre. Such a method of changing the timbre may be applied tobuttons arranged on one screen. For example, the rate of changing thetimbre or pitch of the operation sound may be made different between abutton group of “Item A” through “Item D” and a button group of “Item E”through “Item H” shown in FIG. 7A.

While the above embodiment has been described with the example in whichthe primary input to each of the plurality of buttons is detected andthe operation sound is output at a higher pitch as the detectioninterval of the primary input becomes shorter, the operation sound maybe output at a higher pitch when the primary input to one button issuccessively detected and as the detection interval of the primary inputbecomes shorter. When input is given by touch input, the primary inputto one button is successively detected by the touching finger beingmoved inside and outside the button's display area and back and forthacross the border of the area. The operation sound is then output at ahigher pitch as the detection interval becomes shorter.

In other words, a non-transitory storage medium according to one aspectmay have an information processing program stored therein, and theinformation processing program may be executed in a computer of aninformation processing apparatus and may cause the computer to functionas: input detection means for detecting primary input and secondaryinput to a GUI component; operation sound output means for outputting anoperation sound in time with the primary input to a GUI component; andprocess execution means for, when the secondary input to a GUI componentto which the primary input has been given is detected, executing aGUI-component-assigned process that is assigned to the GUI component andis different from the outputting of the operation sound, where theoperation sound output means may output the operation sound at a higherpitch as a detection interval of the primary input to one GUI componentbecomes shorter.

While the above embodiment has been described with the example in whichthe operation sound is output at a higher pitch as the detectioninterval of the primary input becomes shorter, the operation sound maybe output instead at a lower pitch as the detection interval of theprimary input becomes shorter.

In other words, a non-transitory storage medium according to one aspectmay have an information processing program stored therein, and theinformation processing program may be executed in a computer of aninformation processing apparatus and may cause the computer to functionas: input detection means for detecting primary input and secondaryinput to each of a plurality of GUI components; operation sound outputmeans for outputting an operation sound in time with the primary inputto one of the plurality of GUI components; and process execution meansfor, when the secondary input to the GUI component to which the primaryinput has been given is detected, executing a GUI-component-assignedprocess that is assigned to the GUI component and is different from theoutputting of the operation sound, where the operation sound outputmeans may output the operation sound at a lower pitch as a detectioninterval of the primary input to different GUI components of theplurality of GUI components becomes shorter.

1. A non-transitory storage medium having an information processingprogram stored therein, the information processing program executed in acomputer of an information processing apparatus and causing the computerto function as: input detection means for detecting primary input andsecondary input to each of a plurality of GUI components; operationsound output means for outputting an operation sound in time with theprimary input to one of the plurality of GUI components; and processexecution means for, when the secondary input to the GUI component towhich the primary input has been given is detected, executing aGUI-component-assigned process that is assigned to the GUI component andis different from the outputting of the operation sound, wherein theoperation sound output means outputs the operation sound at a higherpitch as a detection interval of the primary input to different GUIcomponents of the plurality of GUI components becomes shorter.
 2. Thenon-transitory storage medium according to claim 1, wherein the primaryinput and the secondary input are both given by a touch input, andwherein the input detection means detects the primary input whencoordinates of the touch input become included in one of the pluralityof GUI components' own areas, and detects the secondary input whencoordinates of the touch input at an end thereof are included in one ofthe plurality of GUI components' own areas.
 3. The non-transitorystorage medium according to claim 1, wherein the primary input and thesecondary input are both given by actuating a hardware component, andwherein the computer is further caused to function as focus change meansfor, when the primary input is detected, changing the GUI component tobe focused on among the plurality of GUI components as well asdisplaying the focused GUI component visually differently from anunfocused GUI component.
 4. The non-transitory storage medium accordingto claim 1, wherein the input detection means detects a Type 1 inputgiven by using a first input apparatus and a Type 2 input given by usinga second input apparatus, and wherein the operation sound output meansoutputs the operation sound that is different in at least one of pitchand timbre between when the primary input of Type 1 based on the Type 1input is detected and when the primary input of Type 2 based on the Type2 input is detected.
 5. The non-transitory storage medium according toclaim 4, wherein the Type 1 input is a touch input and the Type 2 inputis given by actuating a hardware component.
 6. The non-transitorystorage medium according to claim 5, wherein the operation sound outputmeans outputs the operation sound at a lower pitch when the primaryinput of Type 2 is detected compared to when the primary input of Type 1is detected at the detection interval equal to that of the primary inputof Type
 2. 7. The non-transitory storage medium according to claim 6,wherein the input detection means successively detects the primary inputto each of the plurality of GUI components when one operation iscontinued in the input given by actuating a hardware component.
 8. Thenon-transitory storage medium according to claim 1, wherein the processexecution means changes the screen to a state in which no input isallowed to be given to the GUI component, as the GUI-component-assignedprocess.
 9. The non-transitory storage medium according to claim 8,wherein when the secondary input to one of the plurality of GUIcomponents is detected, the process execution means causes the screen onwhich the GUI component is placed to transition to another screen so asto change the screen to a state in which no input is allowed to be givento the GUI component.
 10. The non-transitory storage medium according toclaim 8, wherein when the secondary input to one of the plurality of GUIcomponents is detected, the process execution means overlays anotherscreen on a layer in which the GUI component is placed so as to changethe screen to a state in which no input is allowed to be given to theGUI component.
 11. An information processing apparatus, comprising:input detection means for detecting primary input and secondary input toeach of a plurality of GUI components; operation sound output means foroutputting an operation sound in time with the primary input to one ofthe plurality of GUI components; and process execution means for, whenthe secondary input to the GUI component to which the primary input hasbeen given is detected, executing a GUI-component-assigned process thatis assigned to the GUI component and is different from the outputting ofthe operation sound, wherein the operation sound output means outputsthe operation sound at a higher pitch as a detection interval of theprimary input to different GUI components of the plurality of GUIcomponents becomes shorter.
 12. An information processing method foroutputting an operation sound in time with an input to a GUI component,the information processing method comprising the steps of: detectingprimary input and secondary input to each of a plurality of GUIcomponents; outputting an operation sound in time with the primary inputto one of the plurality of GUI components; and when the secondary inputto the GUI component to which the primary input has been given isdetected, executing a GUI-component-assigned process that is assigned tothe GUI component and is different from the outputting of the operationsound, wherein, in the step of outputting the operation sound, theoperation sound is output at a higher pitch as a detection interval ofthe primary input to different GUI components of the plurality of GUIcomponents becomes shorter.